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(57) ABSTRACT 

Image attribute detection means for detecting the attribute of 
an input image (attribute "A'*) and image attribute altering 
means for altering the image attribute in the input image on 
the basis of the attribute detection result of the input image 
are provided to output an output image having a new 
attribute (attribute "B'*). The image attribute detection 
means includes first DCT means for subjecting the input 
image to discrete cosine transform to obtain frequency 
components, second DCT means for subjecting the original 
image to discrete cosine transform to obtain original fre- 
quency components, and means of subtracting the original 
frequency components from the image frequency compo- 
nents and dividing the subtraction result by the image 
frequency components to detect the electronic watermark 
data. 

4 Claims, 11 Drawing Sheets 
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IMAGE ATTRIBUTE ALTERING DEVICE 
AND ELECTRONIC WATERMARK 
EMBEDDING DEVICE 



BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention relates to an image attribute altering 
device based on electronic watermark data, and particularly 
to an image attribute altering device based on electronic 
watermark data and an electronic watermark embedding 
device for embedding (inserting) electronic watermark data 
in which copyright owner ship is authenticated, infringe- 
ment of copyright is easily searched, and electronic water- 
mark (which is also referred to as digital watermark) which 
is used for audio, images video, multimedia, etc. is applied 
to provide specific attribute to electronically watermarked 
audio, images, etc., thereby restricting the copies of the 
audio, images, or so like. 

2. Description of the Related Art 

Recently, electro nificd media such as audio, images, 
video, multimedia, etc. have been increased, and also there 
has been required a guarantee system which can easily check 
intellectual proprietary rights such as copyright, etc. and 
data sources. An encryption system in which data are 
temporarily enciphered and only a proprietor can decipher 
the enciphered data is effective as a simple checking method 
as described above, and a method of subjecting original 
media to electronic watermarking has been known as an 
encryption system as described above 

Further, from the viewpoint of protecting the copyright, 
there has been generalized that an attribute is provided to an 
original image to prohibit the original image from being 
copied or allow the original image to be copied only once or 
specific several times. 

In order to alter the attribute of the image as described 
above, an attribute to be embedded during a vertical blank- 
ing period is generally altered. If the alteration of the 
attribute is allowed to be easily performed, the protection of 
the copyright cannot be suflBciently achieved. Accordingly, 
it has been required to prevent unjust copy of digital images 
on the basis of specific restricting conditions. 

With respect to the attribute inserted during the vertical 
blanking period, it has been proposed in Japanese Laid-open 
Patent Application No. Hei-8-275127 that an identification 
signal to be inserted during the vertical blanking period 
(which is referred to as "VBI signal", "video ID" or the like. 
In the following description, it is referred to as "VBI signal") 
is used to prohibit or allow the copy of analog video signals 
of 525 line/60 field. The VBI signal is inserted into each of 
20-th (first field) and 283"^ (second field) horizontal periods 
(IH) during a vertical blanking period in video signals of 
one frame, and 20-bit reference and 20-bits digital signal are 
inserted into an eflfective video signal area after a horizontal 
synchronous signal and a color burst signal. CGMS (Copy 
Generation Management System) information representing 
copy allowance/prohibition is transmitted by 2 bits of the 
20-bit digital signal. 

The method of transmitting the CGMS information by 
using the VBI signal described above is applicable to analog 
signals such as 525- fine standard video signals in NTSC 
system, 625 -line standard video signals in PAL system or 
high-definition video signals such as high- vision signals or 
the like. However, the VBI signal is inserted to a predeter- 
mined place, and it can be easily removed by image pro- 
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cessing such as filtering or the like, so that unjust copying of 
data cannot be prevented 

Therefore, there has been considered a method of embed- 
ding (inserting) electronic watermark data into an original 
s image to prevent unjust use and unjust copy of the digital 
image. 

Two kinds of watermark data, that is, visible electronic 
watennark data and invisible electronic watermark data are 
proposed as electronic data to digital images. 

The visible electronic data is obtained by synthesizing 
special characters or symbols for images so that the char- 
acters or symbols are visible. It induces deterioration of 
image quality, however, has such an effect that it makes a 
visible appeal to users of digital images to prevent unjust 
flow of the images. 

Japanese Laid-open Patent AppUcation No. Hei-8-241403 
discloses an embedding (inserting) manner of visible elec- 
tronic watermark data. This publication discloses a method 

^ of forming a electronic watermarked image, which com- 
prises a step of supplying a digital original image, a step of 
supplying a digital watermark image, a step of forming a 
watermarked image by superposing the watermark image on 
the original image without altering chromaticity of pixels of 

^ the original image when the watermarking is carried out. 
thereby placing the visible watermark on the digital image. 
The electronic watermarked image forming step contains a 
step of correcting pixels corresponding to the original image 
by altering the brightness (not color) for each of pixels 
which are not "transparent" in the watermarked image. In 
this method, when the visible electronic watermark data are 
combined with the original image in this method, the elec- 
tronic watermark data are combined with the original image 
so that only the brightness of the pixels corresponding to the 

2j opaque portion of the electronic watermark data are varied 
and no color component is varied. At this time, the scaling 
value of the variation of the brightness component of the 
pixels is determined in accordance with the color 
component, random number, the pixel value of the electronic 
watermark data. The coospicuousness of the watermark is 
determined by the scaling value. 

Further, the invisible electronic watermark data are 
embedded into the original image so that much attention is 
paid to prevention of deterioration in image quality, and it is 

45 visually insensible because it has little deterioration in image 
quality. 

As described above, if specific infonmation with which 
the identification of a copyright holder is enabled is embed- 
ded as the electronic watermark data, the copyright holder 

50 can be identified by detecting the electronic watermark data 
even after an unjust copying is carried out. Further, if copy 
prohibiting information is embedded, when a reproducing 
device detects the copy-prohibiting information, a user may 
be made to be informed of the fact that the data are 

55 copy-prohibited data, or a copy preventing mechanism in the 
reproducing device may be drive to restrict the copy of the 
data to VTR or the like. 

In order to embed the invisible electronic watermark data 
into digital images, there is known a method of embedding 

60 specific information as electronic watermark data into a 
portion having little effect on the image quality, such as LSB 
(Lease Significant Bit) of pixel data. However, even when 
the above method is used, it is still easy to remove the 
electronic watermark data from images. For example, the 

65 information of LSB of pixels would be lost if a low pass 
filter is used, and also the image compression processing 
aims to reduce the total data amount by omitting the infor- 
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mation amount of such a portion having little effect oa image 
quality. Therefore, the electronic watermark data are lost by 
the image processing, and thus there is such a problem that 
it is difiScuh to rc -detect the electronic watermark data. 

A method of subjecting an image to frequency conversion 
and embedding electronic watermark data into an area where 
the frequency component of a video signal after the fre- 
quency conversion is strong has been also proposed as 
another example of the method of subjecting an image to 
frequency transformation by using a low pass filter ("Nikkei 
Electronics", 1996. 4. 22 (no. 66), p 13). According to this 
paper, as a method of installing ID information into a digital 
work, inherent ID information is installed every purchaser of 
a work (moving pictures, still pictures, photographs and 
sounds are targeted), and the ID information is used to 
expose works (publications, etc.) which were unjustly cop- 
ied by persons other than the purchasers, and the electronic 
watermark data arc embedded into the frequency compo- 
nents of the original works. Therefore, the electronic water- 
mark data are not lost through the image processing such as 
compression processing, filtering or the like. Further, by 
using a normal distribution type random numbers as elec- 
tronic watermark data, the interference between the elec- 
tronic watermark data is prevented, and the destruction of 
the electronic watermark data is made hard without having 
no effect on the overall image. 

FIG. 7 shows the construction described in this paper. The 
method of embedding the electronic watermark data accord- 
ing to the above method is as follows. First, an original 
image 701 is converted to frequency components by using 
DCT (Discrete Cosine Transformation) 703. Data of n which 
show high amplitude in the frequency area are selected, and 
they are represented as follows: 

At), A2),.. •,/(«) 

w(l), w(2), . . . , w(n) of the electronic watermark data 701 
are selected from a normal distribution whose average and 
dispersion are equal to 0 and 1 respectively, and the follow- 
ing equation is calculated for each (i) in electronic water- 
mark data embedding means 704: 

/•(/Hi;o+cix|fl:oixiv(,r 

According to the electronic watermark data embedding 
means 704, the output (f(i)) of DCT 703 is multiplied by the 
electronic watermark data 702 (w(i)) in a multiplier 305, and 
the multiplication result (|f(i)|xw(i)) is multiplied by a 
scaling element a 706 in a mullipUer 707. The multiplication 
result (ax|f(i)|xw(i)) is added with the output of DCT 7 in an 
adder 708 to obtain F(i). 

Finally, by inverse DCT (inverse Discrete Cosine 
Transform) 709, an output image 710 in which the electronic 
watermark data are embedded is obtained from the fre- 
quency components obtained by converting f(i) to F(i). 

Detection of the electronic watermark data is performed 
as follows. In this detection method, an original image 801 
and electronic watermark data candidates w(i) (i=l, 2, . . . , 
n) 809 must be known. 

Referring to FIG. 8, a target image 802 containing the 
electronic watermark data is converted to frequency com- 
ponents by using DCT 804 to obtain the following frequency 
components: F(l), F(2), . . . , F(n). Further, the original 
image 801 is also converted to frequency components by 
using DCT 803 to obtain the following frequency compo- 
nents: f(l), f(2), . . . , f(o). On the basis of f(i) and F(i) thus 
obtained, the electronic watermark data estimation value 
W(i) is calculated and extracted according to the following 
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equation (f(i) is subtracted from F(i) in a subtracter 806, and 
then the subtraction restilt is divided by f(i)) in a divider 807) 
in the elecu-onic watermark data detection means 805: 

Subsequently, statistical similarity C is calculated according 
to the following equation by using the vector inner product 
between the output W(i) of the electronic watermark data 
detection means 805 and the electronic watermark data w(i) 

10 

in an inner product calculator 808: 

C-Wxw/(WDxwD) 

Here, 

15 W=(W(1), W(2), . , . , W(n)), 
w=(w(l), w(2), . . . , w(n)) 
WD=absolute value of vector W 
wD=absolule value of vector w 
2Q Statistical similarity judgment means 810 judges that the 
electronic watermark data concerned are embedded if the 
statistical similarity C is equal to or more than a specific 
value. 

If the electronic watermark data arc embedded into an 

25 image by using the above method, this is effective to a case 
where a copyright proprietor owing an original image carries 
out the detection processing on digital image data which 
seems to be unjustly copied. 

The above method needs the original image, and thus it is 

3Q effective to only the case where the copyright proprietor 
owning the original image performs the detection processing 
on image data which seem to be unjustly copied, however, 

- the reproducing device of each terminal carmot perform the 
detection processing of electronic watermark data because it 

35 has no original image. Therefore, a method obtained by 
improving the above method so that it is applicable to 
terminal processing, particularly an MPEG system has been 
proposed. 

Referring to FIG. 9, according to this improved method, 
an original image 901 is divided into blocks 902 of 8 
pixelsxS pixels, and the embedding and extracting process- 
ing of electronic watermark data is performed by using the 
block 902 as a processing unit. 

Electronic watermark data embedding means 905 per- 

45 forms the frequency conversion through MPEG coding 
processing by using DCT 903. The AC components in a 
frequency area are represented by f(l), f(2), , . . , f(n) in 
increasing order of frequency component. Further, the elec- 
tronic watermark data 904: w(l), w(2), . . . , w(n) are 

5Q selected from a normal distribution having an average of 0 
and a dispersion of 1, and the following equation is calcu- 
lated for each i in the electronic watermark data embedding 
means 905: 

F(0-/(0+<*xavg(/(0)xH<0 

Here, a represents a scaling element, and avg(f(i)) repre- 
sents a partial average obtained by averaging the absolute 
points at three points in the neighborhood of f(i). 
Specifically, f(i) is subjected to partially averaging operation 

60 in a partial average unit 906, the partial average is multiplied 
by the electronic watermark data w(i) 904, the multiplication 
result avg(f(i))xw(i) is multiplied by a constant a in a 
multiplier 909, and the multiplication result axavg(f(i))xw 
(i) is added with the output of DCT 903 in an adder 910. f(i) 

65 is replaced by F(i), and the subsequent processing of the 
MPEG coding processing is carried out. The output F(i) of 
the electronic watermark data embedding means 90S is 
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quaniized according to a quantizing table 912 by a quantizer Here, 

9U and then coded in a encoder 913 to obtain MPEG data. WF-(WF(1). WF(2), .... WF(n)). 

Subsequently, the detection of the electronic watermark w=(w(l), w(2), . . . , w(n)), 

data is carried out for the MPEG data by the following WFDeabsolute value of vector WF 

method. In the following detection method, no original S wD«absohite value of vector w 

image is needed, and it is sufiBcient that the electronic if the statistical similarity C is above a specific value, a 

watermark data w(i) (i«l, 2, . . , n) has been known. statistical similarity judgment means 1109 judges that the 

Referring to FIG. 10, the MPEG data 1001 are decoded in electronic watermark data concerned are embedded, 

a decoder 1002, and then inversely quantized in an inverse The electronic watermark data are detected from an image 

quantizer 1003 to be expanded. Therefore, the inversely lO containing the electronic watermark data concerned and then 

quantized data are subjected to inverse discrete cosine the electronic watermark data concerned are subtracted from 

transform in an inverse DCT unit 1004 to obtain electron!- the image, whereby an original image can be obtained. In 

cally watermarked image data 1005. The image data thus this case, any person other than the copyright proprietor can 

obtained are supplied to a display unit, whereby a display also obtain the original image by using this detection device, 

image containing an electronic watermark is obtained. 15 and thus the reproduction of the original image which is 

The electronic watermark data F(i) in the frequency area contrary to a copyright-proprietor's will is possible, 

of the block after the inverse quantization of the MPEG Therefore, a further improved encryption technique or 

expansion processing is completed is represented by F(l), enhanced secrecy has been required. 

F(2), .... F(D) in increasing order of frequency component. SUMMARY OF THE INVENTION 

The average value of the absolute values at three points in 20 

the neighborhood of F(i) is calculated as a partial average The present invention has been implemented in view of 

avg(F(i)) by a partial average unit 1007, and then F(i) is foregoing situation, and has an object to further enhance 

divided by the partial average avg(F(i)) in a divider 1008 to secrecy for original media such as an original image or the 

obtain electronic data w(i) as follows: clarify a copy-prohibited range and provide an attribute 

25 allow only copies which are subject to a copyright- 

w[i>f(0/avg(ftt)) proprietor's will. 

Further, the sum WF(i) of the W(i) values of one image is , ^° ^"^^ f^^^^ ^"^^'^^^ 

calculated as follows in an adder 1009: WF(i)=W(l)+W(2)+ device accordmg to a first aspect of the present 

. . . +W(n), and the above sum is calculated for each (i). T.^'T'' t .^^'^Tu ""T . 

Subsequently, WF(i) and the electronic watermark data w(i) 30 detecUng an input image (attribute a ) and the attribute of 

1011 are input to an inner produa calculator 1010 to input miage, and image attnbute altcnng means for 

calculate the inner product therebetween, and the statistical ^ff "^.^^^ f- 'T TT -° 

similarity C is calculated by using the vector inner pmduct ^""^^^^^ ^^f^^^ 

as follows- & whereby an output image (attribute "B^ havmg a new 

35 attribute is output. 

C'WFxw/(]VFDxwD) Further, in order to attain the above object, an electronic 

watermark embedding device according to a second aspect 
of the present invention includes discrete cosine transform- 

WF=(WF(1), WF(2), . . . , WF(n)) ing means for subjecting an input image to discrete cosine 

w=(w(l), w(2), . . . , w(n)), 40 transform, electronic watermark embedding means for 

WFD»absolute value of vector WF inserting electronic watermark data into the data obtained by 

wD=absolute value of vector w transforming means, electronic water- 

If the statistical similarity C is above a predetermined means for delecting whether the electronic 

specific value, the statistic simUarity jiidgment means 1012 watermark data to be mserted by the electronic watermark 

judges that the electronic watermark data concerned are « embeddmg means have been already inserted in the mput 

embedded image, and selection means for make the mput usage 

FIG. 11 shows a detection method of electronic water- ^'"""^^ ^ electronic watermark detec- 

mark data of an image after the MPEG expansion processing f"."^ electronic watermark data has been 

is completed. Image data UOl are subjected to discrete "^"''J' ."^"^^ .I'' °' embedding new 

cosine transform in a DCT unit 1102, and the image daU electronic watermark data into the mput unage if it .s 

thus transformed arc represented by F(l). F(2). . . . , F(n) in ^^^'''^ .""^ electronic watennark detection means that 

increasing order of frequency component in the frequency electronic watermark daU has not yet been embedded m 

area of the image block by the electronic watermark daU "'e "nP"' mage. 

detection means U03. The average value of the absolute BRIEF DESCRIPTION OF THE DRAWINGS 

values at three points is calculated as a partial average « pj^. j ^ ^^^^^ ^ ^^^^^^^^ 

avg(F(i)) in a parUally averaging unit 1104, and then the ^j^^ ^^^-^ according to an embodiment of the present 

electronic watermark data W(i) is calculated as follows: invention' 

w(i>/"(j)/avg(f(i)) FIG. 2 is a block diagram showing an image attribute 

go detection device according to the embodiment of the present 

Further, the sum WF(i) of W(i) of one image is calculated invention- 

every (i) in an adder 1105 Subsequently, the statistical j'j^ ^ ^lock diagram showing an image attribute 
^Z'}^'''^ ^c/T"*" el^tronic watermark data w(.) ^^^^ j^^j^^ according to the embodiment of the present 
1106 and WF(i) is calculated according to the following invention- 
equation by using the vector inner product in an inner , ™^ .\ „ ^ l r.^ • 
oroduct calculator 107- * ^ flowchart showing the operation of the image 
* attribute altering device according to the embodiment of the 
C''WFxw/(WFDxwD) present invention; 



09/06/2004, EAST Version: 1.4.1 



us 6,668,068 B2 



8 



FIG. 5 is a block diagram showing the image attribute 
altering device according to another embodiment of the 
present invention; 

FIG. 6 is a block diagram showing an electronic water- 
mark data insertion device according to the embodiment of ^ 
the present invention; 

FIG. 7 is a block diagram showing a conventional elec- 
tronic watcrmaiic data insertion device; 

FIG, 8 is a block diagram showing a conventional elec- 
tronic watermark detection device; 

RG. 9 is a block diagram showing a conventional elec- 
tronic watermark data embedding device; 

FIG. 10 is a block diagram showing a conventional 
electronic data embedding device; and 15 

FIG. 11 is a block diagram showing a conventional 
electronic watermark data detection device. 



DETAILED DESCRIPTION OF THE 
PREFERRED EMBODIMENTS 

Preferred embodiments according to the present invention 
will be described hereunder with reference to the accompa- 
nying drawings. 

First Embodiment 
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FIG. 1 is a block diagram showing an attribute alteration 
processing device according to a first embodiment of the 
present invention. 

In FIG. 1, an input image 101 has an attribute "A" on the 
basis of electronic watermark data which are beforehand 
embedded in the input image 101. An image attribute 
detection device 102 extracts the embedded electronic 
watermark data to detect an image attribute. That is, the 
input image 101 is input to the image attribute detection -^^ 
device 102 to detect the image attribute, thereby obtaining 
an attribute detection result 103 (attribute "A"). The attribute 
detection result 103 and the input image 101 arc input to an 
image attribute altering device 104. The image attribute 
altering device 104 alters the attribute and outputs an output 
image (attribute "B") having a new attribute. 

The image attribute altering device 104 executes the 
operation of altering the attribute ("a") of the image before 
the new electronic watermark data are inserted, and then 
obtaining the image having the new attribute ("B"). 
Accordingly, by defining the meaning of the attribute "A" as 
"copy is allowed only once" and defining the meaning of the 
attribute "B" as "copy prohibited", the image data whose 
attribute is altered to "B" are afterwards prohibited from 
being copied, thereby protecting the copyright. 

Next, the construction of the image attribute detection 
device 102 of FIG. 1 will be described with reference to FIG. 
2. 

In FIG. 2, the input image 101 having the attribute ("A") 55 
is converted to frequency components by DCT 201. In the 
frequency area, an electronic watermark data estimated 
value is extracted in electronic watermark data detection 
means 202. The statistical similarity C between known 
electronic watermark data and the electronic watermark data go 
estimated value is calcidated to obtain an attribute detection 
result 103 of the input image 101. The detail construction is 
the same as the prior an shown in FIG. 11, and it will be 
described later. 

Here, a normal electronic watermark data inserting 6S 
(embedding) method will be described with reference to 
FIG. 7. 
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Referring to FIG. 7, an original image 701 is first con- 
verted to frequency components by using DCT (Discrete 
Cosine Transform) 703. Data of n which have high ampli- 
tude are selected in the frequency area, and they are repre- 
sented as follows: f(l), f(2). . . . , f(n). 

Further, electronic watermark data w(l), w(2), . . . , w(n) 
arc selected from a normal distribution having an average 
value of 0 and a dispersion value of 1, and the following 
equation is calculated for each (i) in the electronic data 
embedding means 704: 

Here, a represents a scaling element Finally, by the inverse 
DCT (inverse Discrete Cosine Transform) 709, the output 
image 710 in which the electronic watermark data are 
embedded is obtained from the frequency components 
obtained by replacing f(i) with F(i). In this embodiment, 
electronic watermark data are inserted in a write-once style 
into an image in which electronic watermark data have been 
already inserted. 

In this embodiment, the operation of converting data to 
the frequency components (frequency area) through DCT 
which is normally carried out is omitted, and the data are 
directly inserted with being left time components (time 
area). The data to be inserted are substituted for a series of 
conversion such as DCT/electronic watermark embedding/ 
inverse DCT as shown in FIG. 6, and the electronic water- 
mark data are inserted every pixel block. When the elec- 
tronic watermark data to be inserted are converted to 
firequency components through DCT, they are set to data in 
a frequency area different from that of the electronic water- 
mark data which were previously embedded. 

Through the above operation, the electronic watermark 
data which are beforehand embedded into an image are 
additionally altered to change the result of the attribute 
detection based on the electronic watermark data. 
Specifically, specific additive data are added to the signal 
calculated at the detection time to aJter the result of the 
attribute detection. In this embodiment, a specific example 
of the internal construction of the additive insertion method 
as described above will be described in more detail. 

FIG. 3 is a block diagram showing an image attribute 
altering device 104. 

In FIG. 3, the image attribute altering device 104 has 
additive insertion data 301 and data "0" 302. The additive 
insertion data 301 are fixed data which are stored in ROM 
or RAM with being developed. The data "0" 302 have the 
same bit width as the additive insertion data 301, and all the 
bit values thereof are equal to "0". These data are selected 
on the basis of the attribute detection result 103 by a selector 
303 and supplied to an insertion data register 306 to hold 
data at a time. The additive insertion data 301 are selected 
when the attribute detection result 103 is equal to "1" (the 
attribute of the input image 101 is "A"), and the data "0" 302 
are selected when the attribute detection result 103 is equal 
to "0" (the attribute of the input image 101 is a value other 
than "A"). 

Here, as an example of the additive insertion data 301, 
three-dimcnsionally arranged numerals of 8x8xk (k repre- 
sents a natural number and it is an inherent value to the 
system and called as "electronic watermark length") are 
added to one field or one frame. For example, one field or 
one frame is divided into 8x8 blocks, and a specific variable 
determinant of 8x8 is inserted to all the blocks or some of 
the blocks. The insertion data 301 of the elecU"onic water- 
mark length indicated in the specific variable determinant 
corresponds to the attribute "B", and it means "copy pro- 
hibited (impossible)". 
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The image attribute altering device 104 of this embodi- 
ment inchides a color difference register 304 for holding 
color diflference signal/brightness signal input from the input 
image 101, and a brightness register 305. These registers 
holds the color difference signalA)righmess signal from the 
input image 101 at the same time when the data arc stored 
in the insertion data register 306. 

For the data thus held, an adder 307 provided in this 
embodiment adds the data held in the brightness register 305 
and the data held in the insertion data register 306. Here, if 
the data selected on the basis of the attribute detection result 
103 by the selector 303 correspond to the data "0" 302, the 
data to be additively inserted as a result is equal to "0", and 
the attribute is not altered. That is, when the attribute of the 
input image 101 is an attribute other than "A", the attribute 
of the output image 105 is not "B". That is, the attribute of 
the output image 105 is not "B" when the attribute of the 
input image 101 is an attribute other than "A". 

When the data selected on the basis of the attribute 
detection result by the selector 303 are the additive insertion 
data 301, the data to be additively inserted as a result 
correspond to the additive insertion data 301. The additive 
insertion data 301 held in the insertion data register 306 are 
added with the data held in the brightness register 305 by the 
adder 307 to obtain a brightness signal, and the brightness 
signal obtained by inserting the additive insertion data 301 
into the brightness components of the input image having 
the attribute "B" is held in the brightness register 309. 

The data thus obtained are held as new brightness data in 
the brightness register 309. In this case, the contents of the 
brightness register 305 and the brightness register 309 are 
coincident with each other. IF the data of the insertion data 
register 306 is not equal to "0", the data has a different 
attribute "B". 

Further, in order to keep the data at the same time, the data 
held in the color difference register 304 is directly supplied 
to and held in the color difference register 308. In this case, 
the color difference register 304 and the color register 308 
are common. 

The data in the brightaess register 309 and the data in the 
color difference register 308 which are held at the same time 
output as image data having a new attribute to an output 
image 105. That is, if the original input image has the 
attribute "A", the image data containing the additive inser- 
tion data in addition to the attribute "A" becomes image data 
having the attribute "B". 

In FIG. 3, in the case where the input image 101 is the 
overall frame image data, the adder 307 can easily add the 
additive insertion data into the input image if the additive 
insertion data is inserted into VBI which is a part of the input 
image. In the case where the input image 101 is image data 
of a block of p pixelsxp pixels, the adder 307 can detect the 
block and add the additive insertion data ff the additive 
insertion data are the data in the same area as the p pixelsxp 
pixels. 

The operation of this embodiment will be described. First 
the operation of the image attribute altering device 104 of 
this embodiment will be described with reference to a timing 
charge of FIG. 4. 

First, the following conditions arc assumed. That is, (a) an 
input color difference signal and (b) an input brightness 
signal are input from the input image 101, and at the same 
time (c) additive insertion data 301 are settled, (d) data "0" 
302 are equal to "0" at all limes. At the same time, (e) the 
value of an attribute detection result 103 is also input Here, 
(c) the additive insertion data 301 are selected when (e) the 
value of the attribute detection result 103 is equal to "1", and 



(d) the data "0" 302 are selected when the value of the 
attribute detection result 103 is equal to "0". At the clock 
periods CLl, CL2, (c) the additive insertion data 301 are 
equal to "SO", "SI", and (e) the vahic of the attribute 

S detection result 103 is equal to "I**, "1". 

At a next time (the risc-up time of a next clock in clock 
synchronization), (f) the color difference register 304 
receives the input color difference signal, (g) the brightness 
register 305 receives the input brightness signal. Further, (h) 

10 the insertion data register 306 receives (c) the value of the 
additive insertion data 301 selected in (e) the attribute 
detection result 103 or (d) the daU "0" 302. Specifically, at 
the clock periods CL2, CL3, (0 the value of the color 
difference register 304 is equal to "CO", "CI", (g) the value 

15 of the brightness register 305 is equal to "YO'^ ^Tl", and (h) 
the value of the insertion data register 306 is equal to "SO", 
"SI". 

At a next time, (1) the color difference register 308 
receives (f) the value of the color difference register 304, and 

20 (j) the brightness register 309 holds the addition result of (g) 
the value of the brightness register 305 just before and (h) 
the value of the insertion data register 306. 

At a next time, (I) the signals of the color difference 
register 308 and (j) the brightness register 309 are output as 

25 a composite image signal (output image 105). 

Specifically, at the clock periods CL3, CL4, (i) the color 
difference register 308 is equal to "CO*', "CI", and (j) the 
brightness register 309 is equal to "YO+SO", "Yl+Sl". As a 
result, the output image is equal to "CO+YO+SO", "C1+Y1+ 

30 SI". These correspond to the above attribute "B". At the 
clock period CL5, (I) the color difference register 308 is 
equal to "C2", and (j) the brightness register 309 is equal to 
"Y2". As a result, the output image is equal to "C2+Y2" and 
the attribute "A" is output at a next time. 

35 Consequently, when an image of the attribute "A" con- 
taining electronic watermark data is continuously input as an 
original image, the same image having the attribute "A" is 
continuously output On the other hand, when an image of 
the attribute "A" containing electronic watermark data is 

40 discontinuously input, the same image having the attribute 
"A" is discontinuously output, and also an image of the 
attribute "B" is output to an empty image portion thereof. 

As described above, the output image 105 (attribute "B") 
is generated from the input image 101 (attribute "A"). 

45 However, as described above, when the data "0" 302 are 
selected by the selector 303, the original data are output with 
no alteration, that is, the attribute is not altered. 

In the above embodiment, the attribute detection result is 
extracted from the input image at least every frame, and the 

50 additive insertion data are inserted as electronic watermark 
data on the basis of the result. However, the attribute 
detection result may be extracted from only a specific block 
of the input image to insert the electronic watermark data 
into the block concemed. Besides, the input image is divided 

55 into plural blocks, the attribute detection result is extracted 
from each block, it is judged every block whether the 
additive insertion data of electronic watermark data should 
be inserted or not, and the additive insertion data is inserted 
into any block in which no electronic watermark data is 

60 inserted. In this case, any block has the attribute "A" and the 
attribute "B", and not only secrecy, but also permission or 
prohibition of copy can be easily detected. 

Second Embodiment 

65 The construction of the second embodiment of the present 
invention is basically the same as the first embodiment 
except for the input image. 
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The consiniction of the second embodiment will be 
described with reference to FIG. 5. 

In FIG. 5, the input image 101 having the attribute "A" is 
input as an analog (composite) signal, however, the subse- 
quent processing after the input of the input image 101 may 
be the same as the first embodiment by using an A/D 
(analog-to -digital) converter 501. Further, for the output 
image 105, the image output having the attribute "B** can be 
obtained as an analog (composite) signal by the same 
construction as the first embodiment if the digitally- 
processed image data are converted to an analog (composite) 
sigaal by using a D/A (digital-to-analog) converter 502 as in 
the case of the input image. 

It is needless to say that the A/D converter 501 at the input 
stage and the D/A converter 502 at the output stage may be 
used at the same time or not at the same time. 

According to this method, the additive insertion of elec- 
tronic watermark data can be performed in the attribute 
altering method of analog images, and thus the copyright of 
analog images can be protected. 

The alteration of the attribute in this embodiment is 
carried out on the assumption that an original media work 
has an attribute "AAA" a work in which first electronic 
watermark data are inserted is altered to an attribute "B" and 
a work in which second electronic watermark data are 
additively inserted is altered to an attribute "CCC, and it is 
not carried out to inquire about whether a work is the 
original or not. 

As described above, the attribute is altered by applying 
the electronic watermark data, so that the image thus 
obtained is an image in which electronic watermark data are 
inserted. 

Accordingly, by providing an equipment side with means 
of detecting the attribute, unjust copies of digital images can 
be prevented. 

Further, according to this embodiment, the selection 
based on the selector is adopted, so that the attribute is 
allowed not to be altered for some specific input images. 

In addition, the insertion of the additive insertion data is 
performed by sequentially inserting the additive insertion 
data into the input image, and thus there is an effect that the 
output image can be obtained on a real-time basis. 

Further, for example, when the meaning of the attribute 
"A" is set to "copy is allowed only once", and the meaning 
of the attribute "B" is set to "copy is prohibited", the image 
data whose attribute is altered to the attribute "B" is pro- 
hibited from being afterwards copied, and the copyright can 
be protected. 

Although, the present invention has been shown and 
described with respect to best mode embodiments thereof, it 
should be understood by those skilled in the art that the 
foregoing and various other changes, omissions, and addi- 
tions in the form and detail thereof may be made therein 
without departing from the spirit and scope of the present 
invention. 

What is claimed is: 

1. An electronic watermark embedding device compris- 
ing: 

discrete cosine transform means for subjecting an input 

image to discrete cosine transform; 
electronic watermark detection means for detecting 

whether electronic watermark data to be inserted by an 

electronic watermark embedding means have been 

already inserted in the input image; 
electronically embedding means for inserting electronic 

watermark data into input image data converted by the 

discrete cosine transform means; and 
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selection means for directly ou^uiting the input image 
with no modification when it is detected by said elec- 
tronic watermark detection means that the electronic 
watermark data has been inserted in the input image, or 
embedding new electronic watermark data into the 
input image when the insertion of the electronic water- 
mark data is not detected, 

wherein said electronic watermark detection means per- 
forms the following operations: on the assumption that 
the original image and electronic watermark data can- 
didates w(i)(i=l, 2, . . , ,n) are known, an image 
containing electronic watermark data is subjected to 
orthogonal transform to be converted into frequency 
components as f(l),f(2), . . . , F(n); 

representing the values of elements corresponding to the 
frequency components containing the electronic water- 
mark data in the frequency domain by F(l), 
F(2), . . . , F(n), the electronic watermark data W(i) is 
calculated and extracted on the basis of f(i) and F(i) 
according to the following equation: 

w('>C/-0>-AO)/AO; 

the statistical similarity C between w(i) and W(i) is calcu- 
lated and extracted by using vector inner product according 
to the following equation: 

C~Wwf(WDxwD), 

Here, 

W=(W(l),W(2),...,W(n)) 

w=(w(l),w(2),...,w(n)) 

WD=absolute value of vector W 

wD=absolute value of vector w 
represents inner product; 
when the statistical similarity C is above a predetermined 
value, it is detected that the electronic watermark data have 
been embedded in the image. 

2. An electronic watermark embedding device compris- 
ing. 

detection means for detecting whether or not a first 
electronic watermark data is inserted into an input 
image in frequency-domain; and 

insertion means for inserting predetermined data into only 
a brightness signal of the input image; 

wherein said insertion means has a selector for selecting 
a second electronic watermark data diGferenl from the 
first electronic watermark data in frequency-domain, 
when said detection means detects a fact that the first 
electronic watermark data is inserted into the input 
image, and for selecting a data of zero, when said 
detection means does not detect a fact that the first 
electronic watermark data is inserted into the input 
image, and 

an adder for adding a data selected by said selector to the 
brightness signal. 

3. The electronic watermark embedding device as claimed 
in claim 2, 

wherein said detection means has means for converting 
the input image into image frequency components 
through discrete cosine transform, means for convert- 
ing an original image into original frequency compo- 
nents through discrete cosine transform, means for 
subtracting the original frequency components from the 
image frequency components, and means for dividing 
a difference on the subtraction by the image frequency 
components. 
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4. The electronic watermark embedding device as claimed means for deciding the fact that the first electronic water- 
in claim 3, wherein said detection means has means for mark data is inserted into the input image, when the statis- 
calcnlaiing an inner product between the result of the tical similarity is greater than a predetermined value, 
division and the first electronic watermark data, means for 

extracting a statistical similarity by the inner product, and ♦ ♦ * » ♦ 



09/06/2004, EAST Version: 1.4.1 



